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AMENDMENTS TO THE CLAIMS 

Please add or amend the claims to read as follows, and cancel without prejudice or 
disclaimer to resubmission in a divisional or continuation application claims indicated as 
cancelled: 

1. (Original) A method of selecting key- frames from a video sequence to produce a subset 
of key-frames for indexing, archiving, browsing and/or searching purposes, comprising 
the following steps: 

(a) producing an initial set of fimnes from said video sequence; 

(b) introducing each frame of said initial set sequentially into a 3 -frame 
buffer to include a middle frame M, its preceding fi*ame L, and its 
succeeding frame R; 

(c) testing for redundancy each M fimne with respect to its preceding L 
fi*ame and its succeeding R frame; and 

(d) selecting as a key-frame for inclusion in the subset those M frames tested 
to be non-redundant. 

2. (Currently amended) The method according to claim 1, wherein each M frame is tested 
for redundancy, with respect to its preceding L fi-ame and its succeeding R frame, by: 

^ representing the M frame as a combination of geometric transformations 
applied to selected regions in the L and R fi-ames; 

(iii) subtracting the geometric transformation of the L and R frames from the M 
frame to produce difference images; and 

{iv) determining from the difference images whether or note the M frame is 
redundant. 
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3. CCurrently amended) The method according to claim 1, wherein each M frame is tested 
for redundancy, with respect to its preceding L frame and its succeeding R frame, by: 

^ iteratively identifying motion entities having relative motion between the M 
frame, its preceding L frame, and its succeeding R frame; 

(vi) utilizing the identified motion entities for identifying regions in the M fimne 
that can be transformed from the L and R frames into the M frame; 

traosforming said identified regions in the M frame to the corresponding 
regions in the L and R fimnes; 

measuring the difference between said identified regions and said 
corresponding transformed regions in the M frame to produce difference images; 

^^t) measuring the areas of said difference images by counting the number of 
pixels of an intensity value above a predetermined threshold; and 

^ discarding the M frame when said measured areas are less than a prespecified 
area threshold. 

4. (Original) The method accorduag to claim 1, wherein: 

some of the frames in the initial set include overlayed frames having graphic 
overlays sup^imposed on live video content, and non-overlayed frames having only live 
video content; 

before step (c), a mask is produced of the graphic overlay in each overlayed frame 
and is utilized to remove the graphic overlay from the live video content in the respective 
overlayed frame; 

step (c) tests for redundancy the live video content in both the overlayed fi-ames 
and the non-overlayed frames; and 



APPLICANT(S): WILF, Itzhak et al. 
SERIAL NO.: 09/647,199 
FILED: April 11, 2001 

Page 4 

step (d) discards those M frames tested to be redundant in both the overlayed 
frames and the non-overlayed frames, such that a subset of key-frames is produced 
based on live video content in the overlayed frames and the non-overiayed frames in the 
initial set. 

5. (Original) The method according to claim 4, v^herein at least one overlayed 
frame is selected as an overlay key-fi^me and is merged with the subset of 
key-frames produced based on live video content. 

6. (Currently amended) The method according to claim 1, wherein at least some of said 
frames in the initial set include frames containing an image of a predetermined 
object[[;]] and wherein at least one such image frame is used for selecting a key-frame 
for inclusion in the subset. 

7. (Original) The method according to claim 6, wherein said at least one image frame is 
used for selecting as a key-frame by: 

detecting at least one such image in a frame in the initial set; 
tracking said at least one image through the video sequence to produce a series of 
image frames; 

computing at least one image-based metric for said image from said series of 
image frames; and 

selecting a key-frame from said series of image frames based on said at least one 
image-based metric. 

8. (Original) A method according to claim 7, wherein said at least one image-based metric 
includes an image self-similarity index and is used to select a plurality of interim key- 
fi'ames. 
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9. (Original) The method according to claim 8, wherein an image quality index is applied 
to said interim key-frames to select a key-frame fi>r inclusion in said subset. 

10. (Original) The method according to claim 1 , wherein said initial set of frames is the 
entire video sequence. 

1 1 . (Original) The method according to claim 1, wherein said initial set of frames is 
produced by selecting every nth frame from the video sequence where n is greater than 
1. 

12 (Original) The method according to claim 1, wherein said initial set of frames is 
produced by selecting frames from the video sequence based on a distance 
metric between frames. 

13. (Cancelled) 

14. (Currently amended) The method according: to claim 13. A method of selecting key- 
frames from an initial set of frames to produce a subset of key- frames for 
indexing, archiving, browsing and / or searching purposes, comprising: testing for 
redimdancy each frame of the initial set with respect to at least its preceding frame by: 

(m ) representing the tested frame as a combination of geometric transformations 
apphed to selected regions in the preceding frame: 

subtracting the geometric transformation of the preceding frame from the 
tested frame to produce dilBference images: and 

feia^ determining from the difference images whether or not the tested fi-ame is 
redundant, wherein said redimdancy test is made by: 

iteratively identifying motion entities having relative motion between 
the tested frame and its preceding frame; 
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utilizing the identified motion entities for identifying regions in the 
tested frame that can be transformed from the preceding frame into the tested frame; 

(^m) transforming said identified regions in the tested fi-ame to the 
corresponding regions in the preceding frame; 

(x\ii) measuring the differences between said identified regions and said 
corresponding transformed regions in the tested frames to produce difference images; 

(xviii) measuring the areas of the difference images by counting the 
niunber of pixels of an intensity value above a predetermined threshold; and 

^a^^ discarding the tested frame when said measured areas are less than a 
prespecified area threshold. 

15. (Original) The method according to claim 14, wherein each frame is tested for 
redundancy also with respect to its succeeding frame in the initial set of frames 
and is discarded if redtmdancy is found in either the succeeding frame or in the 
preceding frame. 

16. (Cancelled) 

1 7 . (Currently amended) The method according to claim 16, wh e r e in said m e thod 
furth e r comprises: A method of selecting key-frames from a video sequence, 
which includes overlaved frames having graphic overlays superimposed on live 
video content, and non-overlayed frames having only live video content, said 
method comprising: 

masking out from said overlayed frames the superimposed graphic 
overlays: 
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testing for redundancy the live video content of neighboring overlaved 
frames and non-overiaved frames: 

selecting as kev-frames the overlaved frames and non-overlaved frames 
whose live video contents were tested to be non-redundant. 

selecting at least one overlayed frame as an overlay key-frame; and 

merging each selected overlay key-frame with the key-frames selected 
on live video content. 

18. (Cancelled) 

1 9 . (Currently amended) A method according to claim — 1-& ^A method of selecting 
kev-frames from a video sequence for inclusion in a subset of kev-frames. 
comprising: 

detecting at least one predetermined image in the video sequence: 

tracking said at least one image through the video sequence to produce a 
series of image frames: 

computing at least one image-based metric for said image from said series 
of image frames: and 

selecting a kev- frame from said series of image frames based on said at 
least one image-based metric, wherein said at least one image-based metric includes 
an image self-similarity index and is used to select a plurahty of interim key-frames. 

20. (Original) The method according to claim 19, wherein an image-quality index is applied 
to said interim key-frames to select a key-frame for inclusion in said subset. 

21. (Currently amended) The method according to claim [[1 8]] 19, wherein said 
predetermined image is a face, graphic or other object image. 
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22. (Cancelled) 

23. (Currently amended) Th e m e thod according to claim 22. A method of selecting key- 
frames from a video sequence, comprising: 

selecting one subset of key-frames which represent at least one feature of the 
video sequence: 

selecting at least one other subset of key-frames which represent at least one 
other feature of the video sequence: and 

comhinmcF 5;ai d at least two subsets of key-frames to produce a combined set of 
key-frames, wherein said combining of the at least two subsets of key-frame comprises 
[[:]] merging said subsets of key-frames to produce said combined set of key- 
frames; 

testing pairs of adjacent key-frames in said combined set of key-frames for 
redundancy; and 

discarding one of the pair of adjacent key-frames where redundancy is found 
to be present in a tested pair. 

24. (Original) A method as claimed in claim 23, where said combined set of key- 
fimnes includes a subset of key-frames selected on the basis of live video content. 

25. (Original) The method as claimed in claim 24^ where said combined set of key- 
frames includes a subset of key- frames selected on the basis of graphic overlays. 

26. (Original) The method as claimed in claim 24, where said combined set of key- 
frames includes a subset of key- frames selected on the basis efface content 
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27. (Original) The method according to claim 24, wherein the key-frame of a pair which is 
discarded when redundancy is found to be present is the key-frame of the pair found to 
have the lower quality index with respect to said live video content 

28. (Original) A method of processing a video sequence of frames including graphic 
overlayed frames having a graphic overlay super imposed on live-video content, 
comprising: 

detecting regions of the graphic overlay in said sequence; generating a mask 
image of said graphics overlay; and 

utilizing said mask image for separating said graphics overlay from at least 
one overlayed frame in the sequence for also generating thereby a live video content 
image in addition to said mask image. 

29. (Original) The method according to claim 28, wherein said live video content image is 
used for selecting a live video content key- frame from said video sequence. 

30. (Original) The method according to claim 28, v^erein said mask image is used for 
selecting a graphic overlay key-fiame from said video sequence. 

31. (Cancelled) 

32. (Cancelled) 

33. (Currently amended) The method according to claim 32. wh e r e in: A method of 
selecting key- frames from a video sequence for inclusion in a subset, 
comprising: 

detecting at least two frames in the video sequence having a 
predetermined face image: 

annlving an image-quality metric to said detected frames: and 
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selecting as a key-frame, for inclusion in said subset, the detected 
frame having the higher image-quality metric, further comprising 

a s e ries of frames in the video sequ e nc e having said predet e miined face image 
are detected; 

applying prior to said step of applying an image-quality metric an image- 
similarity metric io jBrst applied to select a plurality of interim key-frames; and 

a pplying fe en the image-quality metric is applied to said interim key-frames to 
select the key-fi:ame to be included in said subset. 



